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Abstract. For a real reductive linear Lie group G, the space of Whittaker 
functions is the representation space induced from a non-degenerate unitary 
character of the Iwasawa nilpotent subgroup. Defined are the standard Whit- 
taker (g, if )-modules, which are if-admissible submodules of the space of 
Whittaker functions. We first determine the structures of them when the 
infinitesimal characters characterizing them are generic. As an example of the 
integral case, we determine the composition series of the standard Whittaker 
(g, A')-module when G is the group U{n, 1) and the infinitesimal character is 
regular integral. 



1. Introduction 

One of the most basic problems in representation theory is to study the composi- 
tion series of a standard representation. In the category of highest weight modules, 
Verma modules play the role of standard representations, and in the category of 
Harish-Chandra modules, principal series representations do. The composition se- 
ries problem is called the Kazhdan-Lusztig conjecture. 

In this paper, the author propose a Whittaker version of standard (g, ii')-modules 
and study their composition series problem. 

Let G be a real reductive linear Lie group in the sense of [H] and G = KAN be 
an Iwasawa decomposition of it. Let 77 : N — > be a unitary character of N and 
denote the differential representation no — > IR of it by the same letter ij. We 
assume 77 is non-degenerate, i.e. it is non-trivial on every root space corresponding 
to a simple root of A+(go, do)- Define 

(1.1) C°°(G/7V; 77) {/ : G ^ C I f{gn) = v{n)-'f{g), geG,neN} 

and call it the space of Whittaker functions on G. This is a representation space of 
G by the left translation, which is denoted by L. Let C°°{G/N; rf)K be the subspace 
of C°°{G /N;r]) consisting of i^T-finite vectors. As for the subrepresentations of this 
space, there are many deep and interesting results, called the theory of Whittaker 
models. On the other hand, it is not too much to say that the structure of the 
whole space is not known at all. Though our ultimate goal is to determine the 
structure of C°°{G/N;r]), this space is too large to analyze. So we need to cut off 
a submodule of suitable size from it. 

Let, as usual, M be the centralizer of A in K, and let 

Af := {m e M\ rj{m^^nm) = 77(71), 7i e N} 
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be the stabilizer of rj in M. This subgroup acts naturally on C°°{G/N\rf)K by 
the right translation. Consider the subspace of C°° (G / N ; rj) k consisting of those 
functions / which satisfy the following conditions: 

(1) / is a joint eigenfunction of Z(q) (the center of the universal enveloping 
algebra U{Qj) with eigenvalue xa: L{z)J — xa(z)/, z G Z{q). 

(2) For an irreducible representation [a^V^''^) of Af, / is in the (7*-isotypic 
subspace {a* is the dual of a) with respect to the right action of Af. 

(3) / grows moderately at the infinity ([H])- 

Denote by the subspace consisting of / € C°°{G/N; r])K satisfying (1). Then 

and the space Houim^i (Vj'P , 1°^^) is isomorphic to 

{/ : G ^ Vf' I f{gmn) = r,(n)- g G G, m € M\ n e N; 
L{z)f = XA{z)f, zeZiQ); left /^-finite}. 

Therefore, the space of functions / satisfying the above conditions (l)-(3) is iso- 
morphic to 

Iri.A,a {/ G -^^ A (T I / gfows modcratcly at the infinity}. 

We call these the standard Whittaker {q, K)-modules. Note that these are not the 
"standard Whittaker module" defined in [S]. It is easy to show that these are 
iC-admissible and then have finite length fCorollarv l2.4p . 

Though the composition series problem of standard Whittaker (g, i4')-modules 
is an interesting problem by itself, we may hope to apply the result of it to the 
analysis of principal series representations. Iri,A,tT is induced from M^N and the 
behavior of / € Iri,A,a on A is controlled by the infinitesimal character and the 
asymptotic behavior, so we may think this module is near to the principal series 
representation. Therefore, it is significant to compare the structure of this module 
and that of a principal series representation. According to the theory of Whittaker 
models, an irreducible Harish- Chandra module tt can be a submodule of Iri,A,a only 
if the Gelfand-Kirillov dimension of tt is equal to dim CS!)- On the other hand, 
any irreducible Harish- Chandra module can be a submodule of some principal series 
representation. This difference comes from the difference of the structures of /,,,a.(t 
and principal series. So if you understand the common features and the different 
points of these modules, then new insights of Whittaker models and principal series 
are expected to be obtained. 

For example, assume G = 5i(2,R) and the infinitesimal character A is regular 
dominant integral. In this case M = ~ so we identify an irreducible rep- 

resentation of M and that of Af, which is denoted by a. There are two irreducible 
representations of {±1}, one is trivial, denoted by 1, and the other is the signature 
representation, denoted by —1. Let pA — |tr(adn|Lio(jv)) G Lie(A)*. Then the prin- 
cipal series representation Ind^j^^((T ® g^^+PA ) jg reducible if and only if A = cr + 1 
mod 2. There are four equivalence classes of irreducible Harish-Chandra modules 
with the infinitesimal character A. The irreducible principal series is denoted by 
ttqi , the irreducible finite dimensional representation by Wq^ and two discrete series 



STANDARD WHITTAKER, (g, if)-MODULES 



3 



are denoted by ttq, tti. It is well known that the composition series of reducible 
principal series are 

Ind^,^^(a^e^+''-) /\ Ind^,^^(a ® 6"^+"-) ^ \/ 

For the meaning of these diagrams, see Definition 13.31 On the other hand, if 
a e A/'' = A/ corresponds to the reducible (resp. irreducible) principal series, 
then the composition series of the standard Whittaker (g, i4r)-modules are 

(resp. Z^^A^c, ~ Tro;^) 

for an appropriately chosen x]. This result can be obtained by direct computation. 

In this paper, we first determine the structure of /,,,a,ct when A is generic. Let 
Xp((5, v) be the Harish-Chandra module of the C°°-induced principal series repre- 
sentation C°°-Ind^((S ® e^+P^). Here S is an irreducible representation of M . The 
Weyl group of q is denoted by W. Let Ha be the set of equivalence classes of 
irreducible Harish-Chandra modules with the infinitesimal character A. We call A 
generic if every principal series representation with the infinitesimal character A is 
irreducible. The main theorem on the generic case is 

Theorem 1.1 (Theorem 12. 2p . Let G be a real reductive linear Lie group. Suppose 
A is generic and a is an irreducible representation of . Then /° ^ is completely 
reducible. Moreover, the irreducible decomposition of L^^^.a is given by 

(1.2) I,-i,A,a ^ ^ ms{a)Xp{5,v), m5((T) = dimHomA/-, ((5|m^ , cr). 

Xj,(5,i/)6-Ha 

For the non-generic case, there is little result that can be applied to general 
groups. Therefore, we examine the case G = J7(n, 1) in the second half of this 
paper so that it becomes a springboard to the study of general cases. Let tT^j be 
the irreducible Harish-Chandra module of U{n, 1) defined in ? 13.21 The main result 
on this case is 

Theorem 1.2 (Theorem I5.16p . Suppose G — U{n,l) and the infinitesimal char- 
acter A is regular integral. If the highest weight of a € M"^ ~ U{n — 2) x U{1) 
satisfies (|4.ip for some i = 1, . . . , n — 1, j = 2, . . . , n + 1 — «, then the composition 
series of Iri,A.a is 




Here, if i + j — n or n + l, the modules TTa,b, a + b > n + 1, are regarded to be zero 
and the arrows starting from or ending at such modules are omitted. 



'-Ti,A,a 



-77, A. o" 
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This paper is organized as follows. The generic case is treated in S|2j The main 
result of this section is Theorem 12.21 From Sj3] later, we put G = U{n, 1) and ex- 
amine the composition series of /r;,A,o- when the infinitesimal character is regular 
integral. ^ recalls the structure of C/(n, 1) and the classification of irreducible 
Harish-Chandra modules of it. In 21 we first show that /,,,a.o- has a unique irre- 
ducible submodule if it is non-zero. Also determined are the possible irreducible 
modules appearing in the composition series of it. In ^ the composition series of 
Iri,i\,(T is completely determined. For this step, we use the explicit form of iiT-type 
shift operators and the central elements of the universal enveloping algebra. The 
key lemmas for our calculation are Lemma 15.71 and 15.111 and the main theorem of 
the latter half of this paper is Theorem 15.161 In fJH another formulation of our 
problem is discussed. 

Before going ahead, we introduce notation used in this paper. For a real Lie group 
i, the Lie algebra of it is denoted by [q and its complexification by [ = [q ®k C. 
This notation will be applied to groups denoted by other Roman letters in the same 
way without comment. For a compact Lie group L, the set of equivalence classes of 
irreducible representations of L is denoted by L. The representation space of tt e L 
is denoted by . When L is connected and tt is the irreducible representation 
whose highest weight is A, we also denote it by . For n £ L, the contragredient 
representation is denoted by tt* , and if A is the highest weight of tt, then the highest 
weight of TT* is denoted by A* . 

Suppose that K is a maximal compact subgroup of a real reductive group G. 
For a (g, i^)-module tt, the ii'-spectrum {t £ K\t C tt\k} is denoted by K{tt). 

For a numerical vector a = (ai, . . . ,af) e or M^, write |a| ;= X]i=i ^i- This 
notation will be applied for an element of the dual of a Cartan subalgebra when 
this space is identified with numerical vector space by using some fixed basis. 

The author would like to thank Hiroshi Yamashita, Kyo Nishiyama, Noriyuki 
Abe and Hisayosi Matumoto for helpful discussion on this problem. He also thanks 
Torn Umeda, Minoru Itoh and Akihito Wachi for useful advice on the determinant 
type central element of the universal enveloping algebra. This research is partially 
supported by JSPS Grant-in-Aid Scientific Research (C) # 19540226. 

2. The generic case 

In this section, we first write down the differential equations characterizing 1° jy 
After that, we determine the structure of the standard Whittaker (g, iir)-modules 
when A is generic. This is the first main theorem of this paper. As a corollary to the 
proof of this theorem, the if-admissibility of any standard Whittaker (g, i^)-module 
is obtained. 

The if-type decomposition of /° ^ ^ is given by 

^^A.a ^ Hom;,(v;^, J ® v^. 

By Iwasawa decomposition, an element of HomK {V^ , I°jy^^) is determined by its 
restriction to A. For 0i G RomK{Vf , 1° j^^), a e A, m e and v & V^^ , 

(j)i{T{m)v){a) = L{m){(j)i{v)){a) = (l)i{v){m^^a) — (l)i{v){am^^) = a{m)(f)i{v){a). 

Therefore, we may identify 0i with an element (/)2 of C°°(A — )• HomMi (V^ , V^^'')) 
by (j)i{v){a) = (j)2{a){v), v G ,a G A. The g action on (pi can be transferred to 
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02, which we denote by X ■ (j)2- {X ■ (/)2)(a)(w) = L{X){(j)i{v)){a). It follows that 
\Iotsik{V^ is isomorphic to 

(2.1) 

IIkA^) {h e C°°(A ^ HomM.(K'', V;*^")) \z-^2= Xa{z)^2, z € Z(0)}, 
and the subspace lri,K,a{T) of ^.(t) consisting of functions which grow moder- 
ately at the infinity is isomorphic to Hom/^ (V^^, /,,.a,ct)- 

We write down the action of z e ^(fl) on 02- Firstly, the [/({) action is 

(u ■ </)2)(a)(t;) = (i(u)0i(«))(a) = 4>i{T{u)v){a) = </)2 (a) (r («)«), u G [/(£). 

Secondly, consider the action of ?7(a). Denote by 11 = {ai, . . . the set of 
simple roots of A+(go, Qo)- Let Hi,. . . ,Hi be the basis of dual to ai, . . . , a;: 
a, (7?,) = Jy. For t ^ (h, . . . ,ti) € (R>o)', define 

flf =exp ^-^(logti)iJi^ e A. 

For u = EnCn-^r • • --^r e Uia), n = (m, ... ,71;) e (Z>o)', c„ G C, let 

(2.2) at(u) = ^c„ai'^---a,"', 5, :=t,J-. 

Then 

{u ■ (j)2{at)){v) = (at(M)02(at))(^'): G f7(a). 
Lastly, we write down the action of U{n). Denote by (0o)q the root space corre- 
sponding to a root a. Let {Naj \ a G A+(0o, Qo), 1 < j < dim(go)Q} be a basis of 
no such that it satisfies ri{Naj) 7^ if a e H and j = 1, and ri(Na.j) — otherwise. 
We define 



(2.3) ^t(A^aj) 



Urj^Nai,!) if a = e n, j = 1, 
otherwise 



and extend it to an algebra homomorphism U{x\) — >■ C[ti, . . . , i;]. Then 

(u • 02(at))(w) = {L{u)(j)i{v)){at) = r]t{u)(f>i{v){at) = r]t{u)(j)2{at){v) , 

for u e C/(n). Therefore, C/(fl) acts on C°°(^ -> HomA/.,(K^, Kt*^")) by 

(2.4) ((unMnM{) • (j)2){at){v) = rit{un)d{ua)(j)2{at){T{ut)v), 

Un e C/(n),Ua e C/(a),W{ G U{t). 

Choose a Cartan subalgebra tm of m. Fix a positive system A+(m, tm) of the 
root system A(m, tm)- Let 5 S M. Its highest weight with respect to A+(m, tm) is 
denoted by ^s- Note that since we assume every Cartan subgroup of G is commu- 
tative [11] (0.1.2) f)], the highest weight /ia of the restriction of 5 to the identity 
component of M is well defined even if M is not connected. Let P — MAN be the 
minimal parabolic subgroup of G corresponding to our Iwasawa N . For 5 G M and 
1/ e a*, let Xp{5, v) be the Harish-Chandra module of the smooth principal series 
representation C°°-Ind^((5 ® e^+P^). 

Definition 2.1. An infinitesimal character A is called generic if every principal 
series representation Xp{5,v) which admits the infinitesimal character A is irre- 
ducible. 
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Choose a Cartan subalgebra f) tm + a of g. Let W — W{Q,i}) and Wm = 
W{m, tm) be the Weyl groups of q and m, respectively. The httle Weyl group is 
denoted by W{G, A). It is weU known that the infinitesimal character of Xp{S, v) is 
A e f)* if and only if + Prmv) is in the orbit W ■ K. It is also well known that two 
principal series representations Xp{5, v) and Xp{5' ^ v') have the same composition 
factors if and only if there exists w e W{GtA) such that [5' ,v') — {w ■ d,w ■ v). 
We denote by Ak the set of (J, z^) € M x a* satisfying {[i8 + Pm-,v) e W ■ A. The 
set of equivalence classes of irreducible Harish-Chandra modules is denoted by Ha- 
Note that, if A is generic, every member of "Ha is a principal series representation. 
Therefore, Ha is parametrized by W{G, A)\Aa, the set of W{G,A) -orbits in Aa- 

The first main result of this paper is the following theorem. 

Theorem 2.2. Suppose A is generic and a is an irreducible representation of . 
Then 1° is completely reducible. Moreover, the irreducible decomposition o//,,,a,(t 
is given by 

(2.5) Ir,.A,a ^ ^ ms{a)Xp{5,v), m5((T) = dimHomMi ((^U/'j , cr). 

Proof. We first count the dimension of /° ^ (r) . 

Let n be the nilpotent subalgebra opposite to n. We denote by Um and Um the 
nilpotent subalgebras in m corresponding to A+(m, tm) and — A+(m, im), respec- 
tively. Then u := Um + fi is the nilradical of a Borel subalgebra f) + u. Let pm be half 
the sum of elements in A+(m, tm)- We define non-shifted Harish-Chandra maps 7^, 
72 and 7' by 

7l : U{q) = U{m + a) ® {nU{g) + U{Q)n) U{m + a) 
7^ : U{m +a) = C/([)) ® (umC/(m + a) + U{m + o)um) ^ C/(f}) 
7' = 72 ° 7i : U{q) - U{t)) © (uC/(0) + U{g)u) ^ [/(()), 
respectively. Then Harish-Chandra maps are given by 

71 = n o 7^ : Z{g) ^ Z{m + a), ti{H) = H + pa{H),H G a, 

72 = T2 o 7^ : Z{m + n) ^ C/(())'^, T2{H) =H- p^{H), Hel), 

7 = 72071 :^(fl)^C/(f))'^, 

respectively. The infinitesimal character XA is, of course, defined by xa{z) = 
7W(A),zGZ(0). 

Choose a K-type r e ^(/°a,o-)- Suppose z = J^p^n^^i^'^'f '' G U{n) (g) U{a) «) 
U{t) is an element of Z{q). By (|2.4p . elements 02 of /° ^(r) are characterized by 
the system of differential equations 

(2.6) 5]?7t(^l''^)5(uirV2(at)(^(4''V) = XA(^)02(at)(i;), a* G G F,^. 

p 

We know that the system of partial differential equations z-<j)2 — Xa{z)4'2, z G Z[q)^ 
has regular singularity at i = (see the definitions (|2.2I) . (|2.3I) of dt{u) and 774). 
Suppose there exists a non-zero solution ^2 of this system. Then its leading term 
02 satisfies the system of differential equations 
(2.7) 

E^o(4^^)9(4^^)</'^(aO(^(4'^)«) = XA{z)4>l{at){v), z = ^ ^.^f ^^^'^^^ G Z{q). 
p p 
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Since J2pVo{u'^^)u^a^u'f ^ is equivalent to z modulo nU{g), it is the same as 7i(z). 

Therefore, we may assume that, if ?7o(wn^^) 7^ 0, then u''^^ e Z{m). Suppose 6 e M 
satisfies a C S\m^ and S C t\m. Choose a non-zero vector v in the ^- isotypic 
subspace of . Then u'f^ = {/is + Pm){'j2{u'f''))v. Let 1/ + G a* ~ C' be a 
characteristic exponent of a solution (j>2 to p.6p . Here, we identified a* with by 
Citti ^ (ci, . . . , c;). The equation (12.7^ says that /i^ and satisfies 

P 

But since X]p ^o('«n'^)'«i^^M(^^ = 7i('2;), this means that 

(2-8) X(w+P„..')(2) = Xa(^) ^ (Ai5+/5m,J^) € W^- A. 

Since A is regular, wA {w e M^) are all different. Therefore, all the solutions of 
equation (|2.7I) are 

(2.9) 4>l{5,v,i^^,i^2;at){v) ■.^f'+P-i:2oMy), 

■01 e HomA/(r|M,5), 02 e HomA/r,((5|Ai-'7,cr), (/x^ + p^, ;/) e • A. 

Suppose 02, 02 are two solutions of (|2.6p . If all the coefficients of 0§(<5, i^, "01, "02; at), 
d £ M, v & a*, in the power series expansions of 02, 02 are identical, then 02 = 02. 
It follows that the dimension of the solution space of (|2.6I) . i.e. dim/°^^(T), is 
estimated as 

(2.10) dim/°A,cr(T) < ^ dimHomM(T|Af,<5)dimHomA/^(5|Af'', cr). 

Let /°a(^) = HomK(K^,/°A)- % (l2T0l) . we have 

(2.11) dim/;A(r)= ^dimX°A,.(T)dima 

< ^ ^ dimIIomAf(T|M,'5)dimHomj\/>7(5|A/'!,o')dimcr 
= dimHomAi(T|A/, <5) dim5. 

(<5,i/)G.Aa 

In the fundamental paper [7], Lynch gives the dimension of the space of dual 
Whittaker vectors of principal series representations. His result, together with 
Theorem C in [5], says that, if {ps + Pm, i') E W ■ A, then 

dimHom0,K(^p('5,i^),/°A) = #W{G,A) dim (5. 
Since A is generic, (i) every non-zero element in Homg^x(A"p((5, z^), 7° ^) is in- 
jective, and (ii) if Xp{di,iyi) and Xp{d2,^'2) are not equivalent, then for any 
$i e Hom£,^K(A'p(^j, Vi),I° a), « = 1, 2, Image$i n Image$2 = 0. Then we have 

dim/.°A(T) > ^ dimHomj,,/f(Xp((5, i^),/°A)dimHomK(T,Xp((5, i^)) 

Xp{s,u)enA 

^ #W^(G,A)dim(5 X dimHomA/(T|Af,(5) 

[(6,iy)]GW(G,A)\AA 

> dim 7° A (t). 
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Here, we first used the Frobenius reciprocity HomxiT, Xp{6, v)) ~ HomM('''|M, 
and used the fact that every W{G, A)-orhit in Aa consists of 4fW{G,A) elements, 
since A is regular. It follows that every composition factor of 7° ^ is a submodule 
of it. In other words, the modules 1° 1° „ and Iri.A.a- are completely reducible. 
It also follows that the equality in ()2.10p holds. 

In order to complete the proof, we recall a result of Wallach's ([E]). Let dn be 
the Haar measure of N and wq be the longest element of W{G, A) (with respect to 
N). Recall the Jacquet integral 



Note that is right Af-equivariant, since we may choose wq to commute with 
M'^. Let Ind^((5 e^+P^)' be the continuous dual space of C°°-liid${6 (g> e^+P^), 
and Wh.~°° {Xp{S, i^)) be the space of Whittaker vectors in it. Let C°°-lndfj{6) be 
the C°° induced representation of K. As a iiT-representation, this is isomorphic to 
C'^-lnd^{S(g)e''+P^)\K. Let (Indf^(5))' be the space of all continuous functionals 
on C°°-Ind^,/((5), which is endowed with the C°°-topology. 

Theorem 2.3 ([l3]). Let v* e (Vl')*. Then v ^ {v* ,J^{-)(e))s extends to a 
weakly holomorphic map of a* into (Ind^((5))'. Moreover, for any v a* , 



is an isomorphism of vector spaces. Here, ( , )s is the pairing ofVg ^ and its dual. 

The image of a continuous dual Whittaker vector is characterized by the moder- 
ate growth condition (^2j). From this theorem and the map (|2.12p . we know that 
there are ms{cr) = dimHomMi ((^Im") , cr) copies of Xp{S,h') in the socle of Iri,K,a, if 
Xp{5,v) S "Ha- As we noted before the theorem, every member of "Ha is a prin- 
cipal series. So the socle of In,K,a is the right hand side of p.Sp . Since Ir),K,a is 
completely reducible, the theorem is shown. □ 

Corollary 2.4. The standard Whittaker (q, K)-modules are K-admissible and they 
have finite length. 

Proof. If A is regular, the multiplicity of each X-type is finite because of (|2.10l) . 
Such estimate is possible even if A is not regular. The second assertion is clear 
since these modules admit an infinitesimal character and iiT-admissible. □ 

3. The group U{n, 1) and its irreducible Harish-Chandra modules 

Up to now very little is known about the properties of /rj.A.cr with non-generic A, 
so no smart technique can be used for the analysis of it. Therefore, we will choose 
a group G such that the structure of Harish-Chandra modules of it is well know 
and simple (for example if- multiplicity free), and we determine the (g, ivr)-module 
structure of Iri,A,tT for non-generic A by direct calculation. Such an example is 
expected to be a good guide to general cases. 

For such reasons, we assume G — U{n, 1) and A is regular integral hereafter. 



(2.12) 



:C°"-Ind^(<5 ® e-'+P^) ^ C°^{G/NPN- (^Im-.) ® rf) 




(2.13) 
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3.1. Structure of U{n,l). Denote by Eij the standard generators of g[„^]^(C) 
and define /„ i — J2p=i^pp ~ -E'n+i,n+i- Let G — U{n,l) be the subgroup of 
GL{n + 1,C) consisting of the matrices g satisfying *gln,i9 = In,i- The Lie algebra 
00 = u(n, 1) consists of those matrices X £ 0[„^j(C) which satisiy *X/„^i+/„ jX = 
O. Let 6g = In.iQin.i be a Cartan involution of G. The corresponding maximal 
compact subgroup _ftr of G is 

Let 00 — io + So be the corresponding Cartan decomposition of 0o. Then 

is a basis of Sq. 
Let 

h := E„^n+i + En+iji Oo M.h, 
and define / G by f{h) ~ 1. Then Oo is a maximal abelian subspace of So. The 
restricted root system A(0o,ao) is 

A(0o,ao) = {±/,±2/}. 

Choose a positive system 

A+(0o,ao) = {/,2/}, 

and denote the corresponding nilpotent subalgebra J2a£A+{Bo ao}^^o)a by ng. One 
obtains an Iwasawa decomposition 

0o=6o + ao+no, G = KAN, 

where A — exp ao and N = exp no . Let 

Xi := Ein — Eni — Ei^n+1 — En+l,i (1 < * < f^ — 1), 
(3.1) Y, := V^{E,n + Em - E,^r,+l + En+l^i) {l<i<n- 1), 

Z '■= \/ — l{Enn — En+l,n+l ~ En^n+1 + £■«+!,«)• 

Then {Xi,Yi |l<i<n — l}isa basis of (0o)/, and {Z} is a basis of (00)2/- 

In our U{n, 1) case, M is isomorphic to U{n — 1) x U{1). It acts on the space 
of non-degenerate unitary characters of by ry i^- Tf^{n) := rj{m~^nm), m e 
M . Therefore, we may choose a manageable unitary character when we calculate 
Whittaker modules. We use the non-degenerate character 77 defined by 

.o^N v{Xi)^0, i = l,...,n-l, ii{Y,)^0, z = l,...,n-2, 

^ ' 7?(y„-i) = V^e, ^>0, viz) = o. 

It is easy to see that is isomorphic to U{n — 2) x U{1). 

3.2. Classification of irreducible Harish-Chandra modules. We review the 
classification of irreducible Harish-Chandra modules of G = U{n,l) with regular 
integral infinitesimal character. For details, see [5], [B] for example. We use the 
notation nij, Wij etc in [2]. 

There are two conjugacy classes of Cartan subgroups in G, one is compact and 
the other is maximally split. Let He be the compact Cartan subgroup consisting of 
diagonal matrices and let t)c be its Lie algebra. Define a basis {e^ | i = 1, . . . , n+1} of 
i}* by ei{Ejj) = Sij. Choose a maximally split Cartan subgroup Hg :— {He n M)A. 
The complexified Lie algebra [)s of it is the linear span of En {i = l,...,n — 1), 
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Enn + £^n+i,«+i and h. Define e„ e ([)c n m)* by e„(£'jj ) = for j = 1, . . . , n - 1 
and en{Enn + En+i,n+i) = 1. Then e-j, i = 1, . . . , n - 1, e„ and / is a basis of [)*. 

Consider the irreducible Harish-Chandra modules with the regular integral in- 
finitesimal character A, which is conjugate to 



n+l 



(3.3) ^ApepSf)*, ApeZ + n/2, Ai > A2 > • • • > A„+i. 

p=i 

There are n + l inequivalent discrete series representations iTi, i — 0, . . . ,n, whose 
Harish-Chandra parameters are 

i n 

^^ApEp-l- Ap+iep -I- Ai-|_ie„+i, 

p—l p—iJ^l 

respectively, tt; is also denoted by TTi^n+i-i- 

For i — 0, . . . ,n — 1 and j — 1, . . . ,n — i, define fiij G (()c H m)* and i^ij G a* by 

i n—j n— 1 

•~^^^p^p+ 5^ Ap+iep -I- Ap-(_2ep — Pm 

j-g ^-j p=l p=j+l p=n-j-(-l 

+ (Ai+i + A„_j+2)e« 

where pm := ^ ~ '^p)^p- Let 5^ j be the irreducible representation of M 

with the highest weight /Uij, and let Tr^j- := Xp{5i^j^ ^i.j)- Then tt^j- has the unique 
irreducible quotient, which we denote by TTi.j. 

Theorem 3.1. The irreducible Harish-Chandra modules ofU{n, 1) with the regular 
integral infinitesimal character A are parametrized, up to K-conjugacy, by the set 
{tTij" \ i = 0,.-.,n,j = l,...,n + l — i}. 

The if-type structure of Wij is explicitly known. To state the theorem, let 
Aq := 00 and A„_|_2 := —00. As is explained in § [H write \v\ := "^i fo'" 

element v = jy^=i ^i^i G f)*- 

Theorem 3.2 ([6 ). For i = 0, . . . , n and j ~ 1, . . . , n + 1 — i, the K-spectrum 
K{jrij) is 

(3.5) 

{(TA,yf)| Ap_i-7i/2+p-l>Ap>Ap-n/2+p, p=l,...,i; 

Ap — n/2 + p - 1 > Xp> Ap+i — n/2 + p, p — i + 1, . . . ,n — j + 1; 
Ap+i -n/2+p-l>Ap> Ap+2 - n/2 + p, p ^ n - j + 2, . . . ,n; 
|AH|A|}, 

and each K-type occurs in Tfjj- with multiplicity one. 

In order to state the composition series, we use diagrammatic expression. 

Definition 3.3. Suppose Ai, A2 are distinct composition factors of a (g, iir)-module 
V. If there exist elements {vi] C Ai and {Xi\ C g such that "^^XiVi is non-zero 
and contained in then we connect Ai and A2 by the arrow Ai — > A2. 
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Theorem 3.4 ([6], [2]). The composition series ofiTij, i — 0,...,n — 1, j = 
1, . . . , n — i, is 



TTj+lj + l 



+ i = ^'ifi factor TTj+ij-i-i does nof appear. 

4. Composition factors of /,,,a,(t 

In this section we first determine the submodules of /,,,a,ct- For this purpose, we 
need some results on the Whittaker models. 

4.1. Whittaker models. Let (tt, T^) be an irreducible Harish-Chandra module. A 
realization of (tt, V) as a submodule of C°°{G/N; ri)K is called a Whittaker model of 
(tt, F). For a Harish-Chandra module y, let Voo be its C°°-globalization. As in 

let Wh~°°(y) be the space of Whittaker vectors in the continuous dual space of Voo- 
Note that the image of an element of Wh~°°(y) is characterized by the moderate 
growth condition. The next theorem tells us which irreducible (g, ii')-module can 
be a submodule of C°°(G/iV; 77)/^. 

Theorem 4.1 ([8], [9]). Let V he a Harish-Chandra module. 

(1) V has a non-trivial Whittaker model if and only if the Gelfand-Kirillov 
dimension DimV of V is equal to dimiV. 

(2) (Casselman) V — > W]i^°°(V) is an exact functor. 

The Gelfand-Kirillov dimensions of the irreducible modules tt^ j are 
DimTTo.i = 0, 

DimTfi.i = DimTToj = n, i = 1, . . . ,n, j = 2, . . . , n + 1, 

DimTfij- = 2n — 1 = dim N, i = 1, j — 2, . . . ,n + 1 — i. 

See [5] for example. Therefore, an irreducible submodule of Iri.A,i7 is isomorphic to 
one of Tfij, ? = 1, . . . , n, J = 2, . . . , n + 1 — j. 

4.2. Unique simple submodule. Let (tt, V) be an irreducible Harish-Chandra 
module with DimV^ = dimA^. Suppose that it is an composition factor of some 
principal series representation Xp{S, v). By Theorem l4.1f 2') and Theorem l2.31 every 
continuous embedding of Voo into C°°{G/N; rf) is a composition of (i) a realization 
of Voo as a subquotient of C°°-Indp(5 (8) e^^P^^) and (ii) a Jacquet integral. Since a 
Jacquet integral is right A/''-equivariant, V can be a submodule of Iri,A.a only if cr C 
S\mi- Let {Xp{Sp, Vp) \ p — 1, . . . , fc} be the set of principal series representations 
which contain (tt, V") as a subquotient. If (tt, is a submodule of /j,,a,ct, then 
by the above discussion a C ^p=i5p\M^ , i-e. cr is a submodule of 5i\M-n for every 
p=l,...,k. ^ 

Conversely, for a E M^, suppose that there exists a principal series Xp{S,i') g 
Ha such that a C S\mi- Then by Theorem l2.3l the intersection of the image of the 
Jacquet integral (I2.12p and Iri,A,<7 is non-zero. Especially, Iri.A,a- is non-zero. 

Proposition 4.2. Suppose the regular infinitesimal character A is integral. The 
irreducible module Wtj, i = 1, . . . , n — 1, j — 2, . . . , n 4- 1 — i, is a submodule of 
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Iri,A,(T if and only if the highest weight 7 = (71, . . . , 7n-2; 7n-i) of the irreducible 

representation a of ~ [/(n — 2) x U{1) satisfies 

(4.1) 

{Ap-n/2+p>jp > Ap+i - n/2 + p+ 1, p=l,...,i-l, 
Ap+i - n/2+p > 7p > Ap+2 - n/2+p + 1, p = i,...,n- j, 
Ap+2 - n/2+p >-fp> Ap+3 - n/2+p + 1, p ^ n - j + 1, . . . ,n - 2, 
7„_i = |A| - Ep=?7p- 

Especially, /,;,A,cr is non-zero if and only if the highest weight of a satisfies the 
condition (|4.ip for some In this case, Jfij is the unique simple submodule of 

Proof. By Theorem 13. 4[ Tfij-, i — 1, . . . ,n, j = 2, . . . , n + 1 — i, is a composition 
factor of the principal series iTk^i if and only if (fc, I) — {i,j) (only when i + j < n), 
{i,j — 1), (i — or (i — l,j — 1). Therefore, if TFjj- is a submodule of Iri,h,cr, then 
cr C (5ij-|Mi n (5i,j-i |a/'j n (5i-i,j|M'7 n (5i_ij_i|M''- Conversely, if a satisfies this 
condition, then Iri,K.,a is non-zero, as is stated before this proposition. 

Recall the branching rule for the restriction U{m) to U{m—1). For an irreducible 
representation 5^ of U{m) with the highest weight /i = (/xi, . . . , Hm)-, the restriction 
5fji\u(m-i) is a direct sum of a~f G U{m — 1), with 

7 = (71, ■ • ■ ,7m-i), Atp>7p>Mp+i, p=l,...,m-l, 7p G Z. 

It follows that the restriction (5fe,/ G M ~ U^n^l) x [7(1) to M'' ~ U{n-2) x C/(l) is 

a direct sum of cr-^ G U{n — 2) x [/(I), whose highest weight 7 = (71, ... , 7„_2; 7n-i) 
satisfies 

'Ap - n/2+p> 7p > Ap+i - n/2+p+ 1, p = 1, . . - 1, 
Afc - n/2 + fc > 7fc > Afc+2 - n/2 + fc + 1, 

Ap+i - n/2 +p > 7p > Ap+2 - '^/S +p + 1, p = fc+l,...,n-;-l, 
' A„_,+i +n/2-l> 7„_( > A„_,+3 +n/2-l + l, 
Ap+2 - n/2+p > 7p > Ap+3 - n/2+p+ 1, p = n - / + 1, . . . , n - 2, 

Jn-l = |A| -Ep=f 7p, 

if fc + / < n — 1. The last condition for 7„_i is obtained from the action of the 
center of G. Therefore, if i + j < then a G M'' satisfies cr C (5ij |j\fi n(5ij_i|M'j H 
(^i-ij Ufi n (5i_ij_i|Mi if and only if the highest weight 7 of ct satisfies (|4.ip . This 
proves the "only if" part of proposition for the case i+j < n. The case i+j = n + 1 
is shown analogously. 

We will show that the condition is sufficient and that the multiplicity in the socle 
is one. 

Let (M'')ij be the set of cr G A/'' whose highest weight 7 satisfies the condition 
Then it is easy to see that {M^)i,j n (M^)kd = if (ij) ^ (kj). It follows 
that if cr G {M^)ij, then every irreducible factor in the socle of Iri,h,a is isomorphic 
to TTi.j. Let mo- be the multiplicity of such factors. Then dim Wh~°°(7fij) = 
'^(jeChPi)- "^o-dimcr. By Theorems 13.41 and 14.11 we have 

dimWh,y°°(7rij) = ^ dimWh^°°(7fi+aj+b) = ^ ^ Too- dim cr. 

1,6=0,1 1,6=0,1 o-£(M^). + „^^-+i, 
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On the other hand, it is easy to see from Theorem 12.31 and ()4.1|) that 
dmiWh~°° {iTij) — diui Si J ~ dimcr. 

Since nia- > 1 for any a G ^a,b=o,i{M'^)i+a,j+b, they are aU one. This completes 
the proof of proposition. □ 

4.3. Composition factors. Hereafter, we denote In.A,a by /,,,a.7 if the highest 
weight of fj is 7. We also denote by the irreducible representation of Af whose 
highest weight is 7. We first determine the irreducible representations appearing 
in the composition series of Iri,A.-y- 

Proposition 4.3. Suppose that A is regular integral and that 7 satisfies (j4.ip . so 
TTi j is the unique simple submodule oj I^i^Aj-y- In this case, an irreducible module 
TTk.i is a composition factor 0/ /^_a,7 only if {k,l) = {i + a,j + b) with a = 0, ±1 
and 6 = 0, ±1. 

Proof. We have seen in §[2]that, if Tffcj is a composition factor of /,,,a,7, each i^-type 
of it must contain the representation a-y. By ()3.5p and ()4.ip . this is possible if and 
only if (fc, /) = {i + a,j + b) with a = 0,±1 and b = 0,±1. □ 

Proposition 4.4. Suppose that 7 satisfies (j4.ip and {i' ,j') — {i + a,j + b), a,b = 

0, ±1. Then the multiplicity ofwiiji in I^j.A.-y is at least one. 

Proof. By Theorem 13. 4[ Tfi'jv is a composition factor of ■nk^i = Xp{5k,i,Vk,i), with 
{k,l) = {i + a, j + b), a,b ~ 0,-1. Consider the principal series representation 
Xp{5k,hi^) with 1/ e a*. If ly is generic, then Iri.{pk i+Pm-'^)--f isomorphic to 
Xpi^k.ht^) by Theorem 12.21 Here we used the fact ms^. ^{(7^) — 1. Choose a K- 
type T of Tfi'.j'. This is also a if-type of Xp(6kj, v). By Frobenius reciprocity, the 
multiplicity of r in Xpi^Sk^i^v) is one. Therefore, the space of moderately growing 
solutions of (j2.6p . with A replaced by {p-k.i + pxm^) ^-nd ct by ct-^, is one dimensional. 
Let fy be a non-zero moderately growing solution. Then by Theorem l2.3[ this func- 
tion is expressed by the Jacquet integral and it is holomorphic in v. Suppose the 
order of zero of dX v = v^j is m. Let gi, :— fyj (v—Vkj)"^- Then gi,^ , is non-zero. 
It satisfies the equation ()2.6p (with a replaced by a-y) and grows moderately at the 
infinity, so it is an element of Iri,K,i- 

Wc have proved that, for every K-iype t of tt^'j', the multiplicity of r in 1^,^.-1 
is at least one. Since K{Tfa,b) H Kiifa'.b') = if (a, 6) 7^ {a',b'), the multiplicity of 
Tfi'j' in /^.A,7 is at least one. □ 

5. Determination of the composition series 

In this section, we determine the composition series of /,;,a.7 in the case when 
A is integral. For this purpose, we need to write down the actions of Z(q) and s 
on this space explicitly. The former is achieved by the determinant type central 
element of J7(g[„_,_]^), and the latter by the K-type shift operators. 

5.1. Shift operators. We review the K-type shift operators briefly. Choose a 
K-type {t\,V^) of /,,,a,ct, whose highest weight is A. Let be an element of 
Homif (V3^^, /^_A^cr)- For v e V<^ and X e s, define 

i^{v(^X){g) -.^ Lx{i^{v))ig). 
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Then it is easy to sec that ip is an element of HomKiV^^ (E) s,Irj,A,a-)- Here, we 
regard s as a representation of K by the adjoint action Ad. Denote by the set 
of weights on s with respect to a fixed Cartan subalgebra of t. In our case, the 
irreducible decomposition of (g) s is (BaGA,'m{a)V;^^, m{a) = or 1. When 
■m{a) — 1, let ta be the embedding of into (8)S. Define 

Then ^|Ja is an element of KouiKiV^^, Irj,A,a-), and the correspondence tp i-^ ijj a is 
a if -type shift in /,,,a.(t coming from the s-action. 

5.2. Gelfand-Tsetlin basis. In order to write down the if-type shift operators 
explicitly, we realize the space HomMviV^^^Vj"'^) by using the Gelfand-Tsetlin 
basis (13). 

Definition 5.1. Let A — (Ai, . . . , A„) be a dominant integral weight of U{n). A 
(X-) Gelfand-Tsetlin pattern is a set of vectors Q = (qi, . . . , q„) such that 

(1) q.j = ((7i,i,(72,j, • ■ ■,qi,z)- 

(2) The numbers qi,j are all integers. 

(3) Qij+i > Qij > qi+ij+i, for any i = 1, . . . ,j. 

(4) qi,n = A„, z = 1, . . . ,n. 

The set of all A-Gelfand-Tsetlin patterns is denoted by GT{X). 

Theorem 5.2 ([3]). For a dominant integral weight A ofU{n), let {t\,V^^^^) he 
the irreducible representation of U{n) with the highest weight A. Then GT{\) is 
identified with a basis of {t\,V^^^^^). 

The action of elements Eij E gl{n, C) is expressed as follows. Let :— qij — i 
and |qj| X]i=i'?ij- Let cr^^ be the shift operators on GT(A), sending q^ to 

i 

qj + (0, . . . , ±1, 0, . . . , 0). Define aij{Q) and bij{Q) by 
(5.1) 



1 -1 

rifc^ii^fcj+i - ^i-j) nfc^i(^fc,j-i - ^i-j - 1) 



n'fe=i (^fc,j u,j){ik,j h.j 1) 



Theorem 5.3 ([3 ). For Q G GT(A), the action of the Lie algebra is given by 

J 3 

i=l i=l 
n(i?,,)Q -(|q,|-|q,-i|)Q. 

Remark 5.4. The Gelfand-Tsetlin basis is compatible with the restriction to smaller 
unitary groups U{k), k = l,...,n — 1. More precisely, the restriction of t\ to 
U{n—\) is multiplicity free, and the highest weights of the irreducible representation 
appearing in ta|[/(„_i) are the above q„_i's. 

Remark 5.5. The highest weight A* of the contragredient representation (ta», V^) 
of {tx,V^) is A* = (-A„,...,-Ai). In this case, Q* := (q*,...,q;) e GT(A*), 
q* (-gj,j, . . . , is dual to Q e GT(A). 
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(5.3) ((Q',Q))a- 



5.3. Explicit formulas of shift operators. In f|2l we identified an element 0i S 
RoiRKiV^ , with a function 02 G ^r°.A, 7 ('''->») (^r the definition of this space, 

see (HH)). The space KouiM'iiVj^ ,Vf') is isomorphic to {Vj^, (g) V^''''y'^\ the 
space of Af-invariants in K^^^'' . By Remark 15.41 a basis of this space is 
identified with the "partial Gelfand-Tsetlin patterns" 

(5.2) Gr((A/7)*) {Q =(q„-2, q„-i, q„) | 

qn-2 = 7*,qri = A*; satisfies Definition 15. II (1)~(3)}. 
The correspondence is given by 

Gr((A/7)*) {{*,Q))x e HomM.(TAf ,1/*^"), where 

if q'n-i 7^ qr*-i or q;,_2 7^ 7, 

^ (q'l, . ■ . , q;-2) e G'r(7) if = q,*_i and q;_2 = 7, 

for g' = (qi,...,q;)eGr(A). 

The action of fi on Gr((A/7)*) is given by ((Q', (•)Q))a = -((ta(-)O', Q))a. 
Let V^j^, be the vector space spanned by GT{{\/^)*). Then we can identify 

0(a) e G-(A ^ ^^'xhy) ^ith e /"^.^(^a) via 

</)2(a)(t') = ((«,0(a)))A, ^;eV^f,aeA 
We introduce a coordinate system on A defined by 
(5.4) R>o 3t^at:= exp(log(^/t)/i) e A. 

Then the action of q on is given by 

h- (t){at) = 6(t>{at), 9 -.^ t^, F„_i • 0(at) = 0(at), 

(5-5) • 0(at) = for other basis vectors W = Xi, Yi, Z of no, 

W ■ (j){at) = -TA. {W)<j){at) for W 

Here, we used the definition p. 21) of non-degenerate character -q. 

Fix a non-degenerate invariant bilinear form ( , ) on go and choose an or- 
thonormal basis {Wi} of So- Let pr^. be the natural projection from $5 s — 
®aeAs,'7i(a) V^^^y to V^^^y. Then the if -type shift 4' ^ 4'a which is explained 
in ijS.ll is translated into the following operator: 

P„0(at) pr„. o V(/)(aO, V0(at) := ^ • (/)(at) (g) VF,. 

i 

Actually, if we write ia{va) = X^i ^ ^A+a' ^^'^'^ 

^a(«o)(at) - ^(tc.(x'c.))(at) = ^(JZ^a^ ® ^0(«*) = I]iH',^(t'i*^)(at) 

i i 

= E((""' ' • '^(«*))) A = ((E ^'^ ® E w^^- • '^(«*) ® ^^■)) A 

i i j 

= ((ia(t;a),V0(at)))A 

= {{Va,Pa(l>{at)))\+a- 
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Here, {{Q' ®W^,Q ®Wj))'^ := {{Q',Q))x x {W^,WJ). 

In our G ^U{n, 1) case, As = {±(efc - e„+i) | fc = 1, . . . , n} and (A ± (cn+i-k ~ 
e„+i))* = A* T (efe - fn+i)- We write instead of /±(e„^i_fc-£„+i), for simplicity. 
These operators are calculated in [10 . (The expression is slightly different because 
of the change of notation and setting.) 

Proposition 5.6. Suppose (j){at) = Y.QeGT{[x/iy)(^iQ'^'t) Q ^ C°°{A V^^/^^-"). 
Then the K-type shift operators , k — 1, . . . ,n is given by the following formulas: 

(5.6) P+0(at)= ^ 



(5.7) p-<t>{at) 



E 


6fen(g)(^-|A|-|q„_i|- 


- 2lk,n - 2n) c((5;t) cr^. „C 


QeGT((A/7; 






n-1 

-^E 


i>kn(.Q) 0,i,n- 

^ h -I 

_iQGGT((A/7)*) 


i(Q) / + ^ +\ - ^ 
-1 


e' 


akn{Q){d + \M + |q„_i| - 


f 2/fc,„ + 2)c(Q;t) a+„g 


QeGT((A/7; 






n-1 

+^E 


0-kn{Q) bi^n- 

^ /, — /■ 1 

''k,n ''i.n—1 

_iQGGT((A/7)-) 


i^c(ar„_^g;Oa+„g. 



In order to state the next lemma, let '■— oo and qn-i,n-2 '■= —oo. 

{>-hY 



Lemma 5.7. Let (j) be an element of C°°(A v/xi^)* ) 



(1) // 7^_i < A^ and P+ cf) = for k e {2, . . . , n}, then = 0. 

(2) Ifjk-i > K and P^ (j) ^ Q for k e then<f)^0. 

Proof. For any number * depending on g G GT(A), we denote it by *{Q), if we 
need to specify Q. For example, QijiQ) is the Qij part of g e GT{X). 

Since the proofs of these two are analogous, we shall show only (2). Let Qo be an 
element of GT{{X/j)*) which satisfies qk,n-i{Qo) — A^, and let Qi := a^^.^go- 
Then Qi is not in GT{{X/j)*), but (Jk,^_^Qi = Qo e GT{{\/j)*) and a+„gi G 
GT{X* + (efc — e„+i)), because ^^.^i > XI implies that cf^^^Qi satisfies the con- 
ditions in Definition EH] (3): q'fe-i,n-i(gi) > 7fc-i > A^ + 1 = qk,n{<^t,nQ'^) = 
'Zfe,n-i(o'fe'„gi)- Therefore, the term (^^^Qi appears in (|5.7p . and its coefficient in 
(EH) is ' 

afc,n(gi)&fc,n-i(gi) g^. _ afc,«(go)&fc,»-i(gAt«gi) ^^g^. 

^fe,n(gi) — ^fc,n-l(gi) + 1 '^■'"-1 ' ^fe,n(gi) — ^fc,n-l(gi) + 2 

Here, we used the definition (|5.ip of aij{Q) and bij{Q). Since the coefficient of the 
right hand side is not zero, c{Qo; t) = when Pj7(j) = 0- We have shown that c{Q; t) 
is zero for those Q such that qk.n-i{Q) = A^. By induction on A^ — qk.n-i{Q) and 
by using (|5.7p . we can show c{Q; t) = for all Q, if > K- ^ 

5.4. Central elements of C/(g[„^]^). In order to show Lemma [5.111 below . we use 
the explicit forms of the elements in Z{g). One of the most useful forms of the 
central elements of U{qI^_^_i) is the determinant type one ([I]). For the standard 
generator Eij of and a parameter u G C, let Eij{u) := Eij +uSij (Kronecker's 
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delta). We define 

C„+i(w) := ^ sgii(cr)£'^(„+i),„+i(u + n)£'^(„)^„(M + n-l)---£;^(i)^i(u). 

Then C„+i(u) is an element of Z(g[„^]^) for any u, and we obtain all the generators 
of Z{gl^j^i) by specializing u. Since C„+i(u) = 0^=1 (^pp + u + p—l) modulo the 
left ideal generated by strictly lower triangular matrices, the infinitesimal character 
is xa(C„+i(«)) = npi'(Ap + {Ps)p + u + p-l) = Uptliu + Ap + n/2). Here, 
Pb = Ep=i^(Pfl)pep := i 'Eptlin + 2 - 2p)ep. 

Lemma 5.8. Cn+i{u) acts on /r;,A,7 by the scalar Yip^ii"^ + Ap + n/2). 

The exterior calculus is very useful for the manipulation of non-commutative 
determinants. We use the method developed in |4j. 

The exterior algebra AC^''"+^' is an associative algebra generated by 2{n + 1) 
elements ei, . . . , e„+i, e[, . . . , e'^^i subject to the relations CiCj + CjCi = 0, e^ej + 
e^e\ = and e^e^. + e'^e\ = 0. We will work in the algebra AC^f^+i) ® C/(b[„+i), 
where the subalgebras AC^'-"^^' and C/(0l„_(-i) commute with each other. Consider 
the following elements: 

n+1 ri+1 

p=l 9=1 

n+1 n+1 n+1 

= X ^P^q^pqW) = X'^j(")'^J = X^''^^^")- 
p,q=l j=l i=l 

Lemma 5.9 ([4]). (1) For i, j = 1, . . . , n + 1, 

+ l)fyi(w) + + = 0, i]1{u)t]j{u + 1) + J]j{u)i]-{u + 1) = 0, 

(2) Fori,j^l,...,n + l, [E,j ,E{u)] ^ ejf]'^{u) ~ r]j{u)e'i. 

(3) For any u,v d C, and ^{v) are commutative. 

For A: > 0, we consider the element 

S'*^) (u) = E{u)E{u - 1) • • • S(m - /c + 1) = S(u -k + l)S(u - A: + 2) • • • S(u). 
By Lemma \5M it is not hard to see that 

(5.8) SC^) (u) ^kr,j (u)e;s('=-i) (w - 1) 

+ (2(u) - V3iu)e'j) ■ ■ ■ - fc + 1) - - fc + 1)6^-), 

(5.9) =fce,7y^(u-fc + l)S('^-i)(u) 

+ (S(u - fc + 1) - e,r][{u ~k + l))--- (S(u) - e,ry,'(u)), 

(5.10) =?7,(u + n)e^-S(")(u + n- 1) ifi^^j. 

(5.11) 0=e.r;;(u)efee:,+iS("-i)(w + n-l) ifj^i,k. 
From (|5.9p . we obtain 

(5.12) e^e'^^.E^^Hu + n - 1) = ne,e,77:(^x)e;+iS("-i) + n - 1). 
By Proposition 2.2 in |4], 

(5.13) S("+i)(u + n) = (n+l)!C„+i(u)A'°P, 
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where A'°p := 61616262 • • • 6„+i6^_|_]^. We need the cofactor expansion of Cn+i{u) 
along the (n + l)-st row and column. 
By (|3.1I) . we have 



(5.14) 

rjn+iiu + n) - rin{u + = X! 9 (^^p + V^Yp)ep H —Z{e,i + 6„+i) 



p=i 



2 

n-l 



-(/l — i?„„ — En+l.n+1 — 2u— 2n)(6„ — 6„+i), 



1 V— 1 

(5.15) ?7;+i(^^) + v'niu) = ^ -(-Xp - V^Yp)e'p + X_^(_e„ + e„+i) 

p=i 

For two elements a;, y G ^^(0)1 ^ = y means that they are equivalent modulo the 
right ideal generated by X — rit{X), X ^ Wq. Since the actions of elements in go on 
C°° {A — ) are given by (|5.5I) , we have 

S("+i)(^. + n) 

(n + l)n 

= -(?7n+i(^ + n) - 77„(u + n))e'j^.i^'^"''{u + n - 1) 
n 
2 

= -{-ie„_i + {h- Enn - ^^ri+i.n+i - 2u - 2n)(e„ - e„+i)}6^+iS(") (u + n - 1) 
n 

= 2{te„_i ~ {h~ Enn - En+l,n+l - 2u - 2n)6„} 

= {i^e„_ie^_i + t{h + Enn + -Bn+i^n+i + 2u)e„_ieJ^ 

- t{h - Enn ~ En+\,n^\ - 2u - 2n)6„6',_i 

- (/i - Enn - i'n+i.n+i - 2u - 2n){h + + i;„+i_„+i + 2u)e„6^} 

X e„+ie;+iS("-i)(u + n - 1). 

Here, we used (|5.8p . (|5.10p for the first equality, (|5.14p for the second equivalence, 
(|5.1ip . (|5.12p for the third equality, and (|5.15p for the last equivalence. 
By (|5.13p . we have 

e„e;e„+ie;+iS("-i)(M + n - 1) = (n - 1)! Cn-i[u + 1) a'°p . 

From this equation, we see that 

e„6;_ie„+ie;+iS("-i)(u + n - 1) = (n - 1)! ad(^„_i^„)C„_i(u + 1) A*°p, 

e„_ie;e„+ie:,+iS("-i)(u + n - 1) - -(n - 1)! ad(i;„,„_i)C„_i(M + 1) a'°p, 

en-ieJi_i6„+i64+iS(""i'(u + n - 1) 

= (n - 1)! {1 - ad(S„_i,„)ad(S„^„_i)}C„_i(u + 1) A*°p . 

We shall write down the action of C„+i(u) on (/)(at) = X]QeGT((A/7)*) c{Q;t)Q G 

C-(yl^HomM.(X^f ,Kf-'"))- 

Let Um be the nilpotent subalgebra of m consisting of upper triangular matrices. 
Since the q„_i part of Q = (q„_2, qn-i, qn) G GT{{X/j)*) is a highest weight 
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of an element z e ^(iTi) acts on Q by t\.{*-z)Q — 72(-z)(— Qn-i)*?- 

(72 is the non-shifted Harish- Chandra map defined in the proof of Theorem 12.21 ) 
Here, we used (|5.5p and defined *{Zi ■ ■ ■ Zi) := {—Zi) ■ ■ ■ {—Zi) for Zp S g. Since 
72(C„_i(m + 1)) = En-i,n-i{u + u — 1) ■ ■ ■ Eii{u + 1), it acts on Q by the scalar 

Up^li^+P- Qp.n-i) = UpZliu- Ipm-i) S{Q). 

For z e Z{g), let Vx -ylz) be the differential operator on C°°{A — > V^j^, ) 
defined by z • — 'D\,^{z)(j). Bringing the above results together, we get the 
following formula. 

Proposition 5.10. The action of Cn+i{u) on 4'{at) € C°°{A — > ^{x^/^)") 
pressed as follows: 

-4I?A,7(C„+i(u))0(at) 



?eGT((A/7)-) 

n-1 



{{6 - - (|A| + |q„_i| +2u + nf - A{Q)e) c{Q;t) 



(5.16) - t E "^"7'^^\ g + |A| + |q„-i I + 1 + 2u)c{a+^_^Q- 1) 



tJ2 ^'^^-'^^h e - |A| - |q„_i| + 1 - 2n - 2«)c(cTp-„_iO;t) 

P—1 ^' 



^ bp,n-liQ) ar,n-l{<yp^n-lQ) 
p„i (u - 'p,n-l)('« - ^r,n-l) 



A{Q) =1 - E "P'"^^^'^'*^ ~ fep,K~i(Q) 



p=l 

Lemma 5.11. Let t\ be a K-type of In^K.-y- On the space C°°{A Vj-^y*^, ), the 



operators P^. o P'^ and o P^, , fc G {1, . . . , n}, are central, namely 

(5.17) P^ O P+ ^ Vx^y{C„+l{lk,n)), O P- = 2?A,^(C„+i(?fc,„ + 1)). 



Proof. By Propositions 15.61 15.1Q[ we know that we may show the identity 

[Qf ^ bp,^.,{Qf 



1 = 



p—l ^^1^ Ip^n—l p—i ^k,n lp^n—1 "t" 1 



This identity is obtained by comparing the coefficient of <y^,^Q in the identity 

T\'{En^n+l)Q — T\t{[En^n-l, [En~l,n-, En,n+l\])Q ■ □ 

5.5. Determination of composition series. In this subsection, we determine the 
composition series of /,,,a.7- When something concerning the irreducible modules 
TTa.b is described, the statement concerning them is assumed to be excluded if there 
is not such module Tfa,b, i-e. ifa + 6>rt + l. 

Lemma 5.12. Suppose that 7 is given by (|4.ip . // a pair Vi and V2 satisfies one 
of the following conditions, then there is no non-zero Q-action in /r;,A,7 which sends 
Vi to V2: 

(1) Vi ~ Wij, V2 ~ Wi+a,j,T^ij+b, a,b = ±1. 
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(2) Vl ~ T^i+a.j, V2 — T^i+a,j+b, a,b — ±1. 

(3) Vl ~ Wij+b, V2 ~ Tfi+a.'j+b, a,b ^ ±1. 
(Any double signs are allowed.) 

Proof. If there is a g-action sending an element of 7ro_b to na',b', then the if -spectra 
^(7fa,h) and K{j:a',b') should be adjacent, i.e. there should be if-types € Kijfa.b) 
and T\i e K{'Wa',b') such that A — A' is a weight of s. 

Assume that Vi and V2 are isomorphic to Jfij and ni-ij, respectively, and 
Vl ^ V2. Two if- types A e Kijfi^j) and A' e iir(7fi_ij) are adjacent if and only if 
\i — Ki — n/2 + i, A^ = Ai — n/2 + i — 1 and Ap — A^ for p ^ i. Recall the discussion 
in § 15.31 The s-action which sends an element of V^ C Vi to V^ C V2 is realized 
by the shift operator 

Consider the shift P^+i^i ° Pn+i-i'P- Lemma [5 . 11 1 asserts that this is equal to 
'Dx,^{C„+i{ln+i^i.n + i))(f> = XA{C„+i{ln+i-i,n + By Lemma we know 

that XA(C„+i(;„+i_i,„ + l)) = 0, since Z„+i-i,„ A*+i_,; - (n+ 1 - i) = -Ai-(n + 
l-i) = -(A,-n/2+i)-(n+l-z) = -A,-n/2-L Therefore, P+^^_,P-+^_,ct) = 0. 
Now, A- = A,: — n/2 + i — 1 < 7^-1 implies (A')*^i_j > 7*i_i, and the condition 
l<z<n— lof Proposition 14.21 is paraphrased as2<?T.+ l — i<n. Under these 
conditions, P^+i^i is injective by Lemma |5.7[ so P~_^_i_^(f> = 0. But this contradicts 
Vl — )■ V2. Therefore, Vi 7^ V2. Other cases can be shown analogously. □ 

Corollary 5.13. The multiplicity ofJfi^j in Iji, A,-y is one. 

Proof. We know that the socle of /,,.a,7 is isomorphic to 7fi,j fProposition 14.31) . 
Assume that there exists a composition factor Vi which is isomorphic to tt^ j but 
is not in the socle. By Proposition 14.31 ifa^b is a composition factor of /r;,A,7 only 
if a = i,i ± 1 and b = j,j ± 1. By Theorem 13.21 it is adjacent to Vi if and only 
if \a — a'\ + \b — b'\ = 1. Therefore, there exits a composition factor V2 which is 
isomorphic to one of TTi±ij, T^i,j±i such that Vi — >■ V2. But we have shown in 
Lemma [5.121 that this is impossible. □ 

Lemma 5.14. Suppose that 7 is given by ()4.ip . 

(1) The socle of I,,^\^^/Trij is TTi~ij ® Tfij'+i 7fij_i (BTTi+ij. 

(2) The multiplicities of7fi±ij,Tfij±i in I^i^A.-y o.'fe all one. 

Proof. (1) As we stated in the proof of the previous corollary, a composition factor 
V is adjacent to only if V is isomorphic to one of 7ri±ij-, 7fij±i. So only TTi±ij, 
TTi,j±i can be a simple submodule of lr),K.,-^ jT^i.j- We know from Proposition 14.41 
that the multiplicity of each of them in Iri,A,-y is at least one. 

Choose a composition factor V isomorphic to, say, 7fi_ij-. Other cases can be 
shown analogously. Recall the proof of Lemma 15.121 Let (j) be the function which 
characterizes the non-zero if-type A' of V ~ Ifi-ij. Assume that there is no non- 
zero s-action from V to the unique simple submodule which is isomorphic to i^i^j. 
Since the multiphcity oiifi.j in /,,,a,7 is one, P^_^i_i(j} — 0. But we have seen in the 
proof of Lemma [5. 121 that this implies = 0. This is a contradiction, so V ^ Tfij-. 

Assume that there are two composition factors Vi, V2 in the socle of Iri,A,'y/T^i,j, 
both of which are isomorphic to Wi^ij. Let (f>k, k = 1,2, be the functions which 
characterize the non-zero if- type A' of 14, respectively. Then both of P^+i-ifpk 
characterize the same if -type A of the unique simple submodule, and the multiplic- 
ity of this if -type is one, there are constants Cfc such that ciP^_^i_^(l)i — C2Pn+i-i4>2- 
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Since P^_^_l_^ is injective in this case, this implies that ci0i + C202 = 0. This con- 
tradicts the fact that (pk, k = 1,2, characterize the X- types A' of different factors 
Vk, k = 1,2. Therefore, the muhiphcity of 7fi_ij- in the socle of Iri,K,-y /T^i,j is one. 

(2) Assume that there is a composition factor Vi isomorphic to, say, T^i-i,] but 
not in the second floor of Iri.A,'y The irreducible modules which are adjacent to 
Tfi-ij are Wij and Tfi-ij±i. Therefore, there exists a composition factor V2 in the 
third or higher floor such that it is isomorphic to one of the above and Vi — > V2. 
But this is impossible since (i) the multiplicity of Ifij is one and it is located in the 
bottom, and (ii) T^i-i.j 7^ T^i-i,j±i by Lemma I5.12f 2). □ 

Lemma 5.15. Suppose that 7 is given by ()4.1|) . 

(1) The socle of {Ir,, A,j/Tri.j)/{n,^i j(STri^j+i(STTij-i®Tf i+ij /ifij) zs7fi_ij_i® 
Tfi-ij+i 7fi+ij_i ® Tfi+i . Moreover, the non-zero s-actions from the 
third floor to the second are Tfa.j±i T^a.j o,nd 7f.i±i,(, — >■ T^i^h, a = i ± 1, 
b = j±l. 

(2) The multiplicities of ■Ki±i_j±i in Iji, A,-y are all one. 

Proof. The proof is almost the same as that of Lemma 15.141 

Since (i) the multiplicities of 7fij±i, 7fi±ij- and Wij are one, and (ii) they are in 
the first or second floor, the third floor is a direct sum of Tf^-i-i j±i's, and there is 
no higher floor in Ir/^A.-y- 

For each 'ni±ij±i, there exists at least one factor isomorphic to it in /,j,a,7- 
Suppose, say, Vi ~ 7fj_i and V2 — Wij^i, the latter is in the second floor. Let 
(j> be the function which characterizes a i^-type of Vi adjacent to Wij^i. The shift 
operator sending to a i^-type of V2 is Pn+i-i- The proof of Lemma [5.121 savs 
that this is injective. Therefore, Vi — >■ V2. The uniqueness of the factor isomorphic 
to 7fi_i is shown in the same way as in the proof of the previous lemma. □ 

We have obtained the following second main theorem of this paper. 

Theorem 5.16. Suppose that G = U{n, 1) and the infinitesimal character A is 
regular integral. If the highest weight of a £ ~ U{n — 2) x U{1) satisfies (14. ip 
for some i = 1, . . . , n — 1, j = 2, . . . , n + 1 — i, then the composition series of Iri.A,^ 
is 



(5.18) 




Here, if i -\- j = n or n-\-l, the modules Hafi, a + b > n + 1, are regarded to be zero 
and the arrows starting from or ending at such modules are omitted. 

6. Ending remark 

In this paper, we characterized the module Iri,A.a by the conditions (l)-(3) in §[1] 
The condition (1) is imposed to make the modules /°^, /° ^ u ^'i^d I,^^A,a suitably 
small, i.e. if-admissible. The author thinks that it is interesting to investigate 
the structure of modules which are characterized by other conditions that make 
the modules in question if-admissible. For example, if the real rank of G is one. 
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we may replace the condition "/ is a joint eigenfunction of Z{q)'' in (1) with "/ 
is an eigenfunction of the Casimir operator and admits a generahzed infinitesimal 
character". Under the latter condition, the module is still if-admissible and has 
finite length. For G = U{n,l), the composition series of such module (with the 
trivial generalized infinitesimal character) is 




This structure is more symmetric than that of In,A,a- 
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